A Multi-Institution Collaboration to Define Core Content and Design Flexible Curricular Components for a Foundational Medical School Course: Implications for National Curriculum Reform.

Medical educators have not reached widespread agreement on core content for a U.S. medical school curriculum. As a first step toward addressing this, five U.S. medical schools formed the Robert Wood Johnson Foundation Reimagining Medical Education collaborative to define, create, implement, and freely share core content for a foundational medical school course on microbiology and immunology. This proof-of-concept project involved delivery of core content to preclinical medical students through online videos and class-time interactions between students and facilitators. A flexible, modular design allowed four of the medical schools to successfully implement the content modules in diverse curricular settings. Compared with the prior year, student satisfaction ratings after implementation were comparable or showed a statistically significant improvement. Students who took this course at a time point in their training similar to when the USMLE Step 1 reference group took Step 1 earned equivalent scores on National Board of Medical Examiners-Customized Assessment Services microbiology exam items. Exam scores for three schools ranged from 0.82 to 0.84, compared with 0.81 for the national reference group; exam scores were 0.70 at the fourth school, where students took the exam in their first quarter, two years earlier than the reference group. This project demonstrates that core content for a foundational medical school course can be defined, created, and used by multiple medical schools without compromising student satisfaction or knowledge. This project offers one approach to collaboratively defining core content and designing curricular resources for preclinical medical school education that can be shared.

Medical Student Perceptions of the Learning Environment in Medical School Change as Students Transition to Clinical Training in Undergraduate Medical School.

Phenomenon: The learning environment is the physical, social, and psychological context in which a student learns. A supportive learning environment contributes to student well-being and enhances student empathy, professionalism, and academic success, whereas an unsupportive learning environment may lead to burnout, exhaustion, and cynicism. Student perceptions of the medical school learning environment may change over time and be associated with students' year of training and may differ significantly depending on the student's gender or race/ethnicity. Understanding the changes in perceptions of the learning environment related to student characteristics and year of training could inform interventions that facilitate positive experiences in undergraduate medical education. APPROACH: The Medical School Learning Environment Survey (MSLES) was administered to 4,262 students who matriculated at one of 23 U.S. and Canadian medical schools in 2010 and 2011. Students completed the survey at the end of each year of medical school as part of a battery of surveys in the Learning Environment Study. A mixed-effects longitudinal model, t tests, Cohen's d effect size, and analysis of variance assessed the relationship between MSLES score, year of training, and demographic variables. FINDINGS: After controlling for gender, race/ethnicity, and school, students reported worsening perceptions toward the medical school learning environment, with the worst perceptions in the 3rd year of medical school as students begin their clinical experiences, and some recovery in the 4th year after Match Day. The drop in MSLES scores associated with the transition to the clinical learning environment (-0.26 point drop in addition to yearly change, effect size = 0.52, p < .0001) is more than 3 times greater than the drop between the 1st and 2nd year (0.07 points, effect size = 0.14, p < .0001). The largest declines were from items related to work-life balance and informal student relationships. There was some, but not complete, recovery in perceptions of the medical school learning environment in the 4th year. Insights: Perceptions of the medical school learning environment worsen as students continue through medical school, with a stronger decline in perception scores as students' transition to the clinical learning environment. Students reported the greatest drop in finding time for outside activities and students helping one another in the 3rd year. Perceptions differed based on gender and race/ethnicity. Future studies should investigate the specific features of medical schools that contribute most significantly to student perceptions of the medical school learning environment, both positive and negative, to pinpoint potential interventions and improvements.

The Use of Short, Animated, Patient-Centered Springboard Videos to Underscore the Clinical Relevance of Preclinical Medical Student Education.

PROBLEM: Medical students often struggle to appreciate the clinical relevance of material taught in the preclinical years. The authors believe videos could be effectively used to interweave a patient's illness script with foundational basic science concepts. APPROACH: In collaboration with four other U.S. medical schools, educators at the Stanford University School of Medicine created 36 short, animated, patient-centered springboard videos (third-person, narrated accounts of authentic patient cases conveying foundational pathophysiology) in 2014. The videos were used to introduce students to 36 content modules, created as part of a microbiology, immunology, and infectious diseases curriculum. The videos were created with input from faculty content experts and in some cases medical students, and were piloted using a flipped classroom pedagogical approach in January 2015-June 2016. OUTCOMES: Student feedback from course evaluations and focus groups was analyzed using a mixed-methods approach. On the course evaluations, the majority of students rated the patient-centered videos positively, and the majority of comments on the videos were positive, highlighting both enhanced engagement and enhanced learning and retention. Comments from focus groups mirrored the course evaluation comments and highlighted different usage patterns for the videos. NEXT STEPS: The authors will continue to gather and analyze data from schools using the videos as part of their core preclinical curriculum, and will produce similar videos for use in other areas of undergraduate medical education. These videos could support students' review of content taught previously and be repurposed for use in continuing and graduate medical education, as well as patient education.

Role-modeling and medical error disclosure: a national survey of trainees.

PURPOSE: To measure trainees' exposure to negative and positive role-modeling for responding to medical errors and to examine the association between that exposure and trainees' attitudes and behaviors regarding error disclosure. METHOD: Between May 2011 and June 2012, 435 residents at two large academic medical centers and 1,187 medical students from seven U.S. medical schools received anonymous, electronic questionnaires. The questionnaire asked respondents about (1) experiences with errors, (2) training for responding to errors, (3) behaviors related to error disclosure, (4) exposure to role-modeling for responding to errors, and (5) attitudes regarding disclosure. Using multivariate regression, the authors analyzed whether frequency of exposure to negative and positive role-modeling independently predicted two primary outcomes: (1) attitudes regarding disclosure and (2) nontransparent behavior in response to a harmful error. RESULTS: The response rate was 55% (884/1,622). Training on how to respond to errors had the largest independent, positive effect on attitudes (standardized effect estimate, 0.32, P < .001); negative role-modeling had the largest independent, negative effect (standardized effect estimate, -0.26, P < .001). Positive role-modeling had a positive effect on attitudes (standardized effect estimate, 0.26, P < .001). Exposure to negative role-modeling was independently associated with an increased likelihood of trainees' nontransparent behavior in response to an error (OR 1.37, 95% CI 1.15-1.64; P < .001). CONCLUSIONS: Exposure to role-modeling predicts trainees' attitudes and behavior regarding the disclosure of harmful errors. Negative role models may be a significant impediment to disclosure among trainees.

Empowerment evaluation: a collaborative approach to evaluating and transforming a medical school curriculum.

Medical schools continually evolve their curricula to keep students abreast of advances in basic, translational, and clinical sciences. To provide feedback to educators, critical evaluation of the effectiveness of these curricular changes is necessary. This article describes a method of curriculum evaluation, called "empowerment evaluation," that is new to medical education. It mirrors the increasingly collaborative culture of medical education and offers tools to enhance the faculty's teaching experience and students' learning environments. Empowerment evaluation provides a method for gathering, analyzing, and sharing data about a program and its outcomes and encourages faculty, students, and support personnel to actively participate in system changes. It assumes that the more closely stakeholders are involved in reflecting on evaluation findings, the more likely they are to take ownership of the results and to guide curricular decision making and reform. The steps of empowerment evaluation include collecting evaluation data, designating a "critical friend" to communicate areas of potential improvement, establishing a culture of evidence, encouraging a cycle of reflection and action, cultivating a community of learners, and developing reflective educational practitioners. This article illustrates how stakeholders used the principles of empowerment evaluation to facilitate yearly cycles of improvement at the Stanford University School of Medicine, which implemented a major curriculum reform in 2003-2004. The use of empowerment evaluation concepts and tools fostered greater institutional self-reflection, led to an evidence-based model of decision making, and expanded opportunities for students, faculty, and support staff to work collaboratively to improve and refine the medical school's curriculum.